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Abstract. 

Progress is being made in code discoverability and preservation, but as discussed 
at ADASS XXI, many codes still remain hidden from public view. With the Astro- 
physics Source Code Library (ASCLf] now indexed by the SAO/NASA Astrophysics 
Data System (ADS), the inttoduction of a new journal, Astronomy & Computing, fo- 
cused on astrophysics software, and the increasing success of education efforts such as 
Software CarpenUy and SciCoder, the community has the opportunity to set a higher 
standard for its science by encouraging the release of software for examination and pos- 
sible reuse. We assembled representatives of the community to present issues inhibiting 
code release and sought suggestions for tackling these factors. 

The session began with brief statements by panelists; the floor was then opened for 
discussion and ideas. Comments covered a diverse range of related topics and points 
of view, with apparent support for the propositions that algorithms should be readily 
available, code used to produce published scientific results should be made available, 
and there should be discovery mechanisms to allow these to be found easily. With 
increased use of resources such as GitHub (for code availability), ASCL (for code dis- 
covery), and a stated strong preference from the new journal Astronomy & Computing 
for code release, we expect to see additional progress over the next few years. 



'http://ascl.net/ 
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1. Introduction 

This Birds of a Feather (BoF) session was held to gather ideas on how to better make 
astronomical software discoverable and preserve it to improve the transparency of re- 
search, ensure reproducibility, and advance numerical methods in the field. How to 
handle software is often discussed at ADASS, and this BoF builds directly on Teuben 
et al. (2012). The authors feel that recent changes in the field create an opportunity to 
put the community on a path for permanent change regarding software discoverability, 
sharing, and advancement of these methods. 



2. Efforts in the Community 

The astronomy community has begun to recognize the need to and benefits of publish- 
ing and sharing software. A number of efforts are building greater cooperation and 
actively working to improve the way astrophysics is done, and have started to have an 
impact on the development, visibility, and preservation of codes. These efforts include: 

• Blogs such as Astronomy Computing TodajQ and AstroBetterJ3 devoted in part 
or wholly to software topics and doing things better. 

• Projects such as Software CarpentrjQ and SciCodei0 to improve coding skills. 

• Increasing efforts to recognize the role of the astronomical software professional 
in advancing the field through the development of astroinformatics conferences, 
coursework, and code citation. 

• Expansion of the ASCL, indexing of its entries by ADS, and ADS's exploration 
of linking papers to code entries and code entries to papers. 

• Collaborative coding efforts such as AstroPy0 

• Social software bringing astronomers together in previously unprecedented ways 



• Launch of a journal, Astronomy & Computing, devoted to the development and 
use of software methods in astronomy. 



2 http://as trocompute.wordpress.com/ 
3 http://www.as trobetter.com/ 
4 http://software-carpentry.org/ 
5 http://w w w. scicoder.org/ 
6 http://www.as tropy.org/ 

7 https://groups.google.com/forum/?fromgroups#!forum/AstroShareGroup 
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3. Barriers to Code Discoverability 

Despite progress, significant barriers still exist which inhibit code release; many of 
these have been discussed in the literature and at ADASS. Reasons developers do not 
release codes include: 

• Code "messiness" (Barnes, 2010). 

• University policies that prohibit distribution of intellectual property. 

• Lack of documentation and examples. 

• Perceived lack of suitability for sharing, as the code may have a narrow focus 
and/or seem too trivial to share. 

• Protection of proprietary processes useful for future funding of author. 

• Code release not firmly established as a standard practice. 

• Lack of incentive/little or no perceived upside to releasing code. 

4. Discussion Questions 

The focus of the BoF was to discuss and solicit answers to the following questions: 

• How do we ensure code release is recognized as an essential part of assuring 
reproducibility of research? 

• How can the community change the culture so coders will release their programs? 

• What can we do to ensure developers receive credit for writing and releasing their 
software, and encourage them to release it even if it's "messy" code? 

• How do we reduce expectations of support when a developer does not wish to (or 
cannot) take on that role after program release? 

• What role might journal publishers and funding agencies have in furthering code 
release, and how can the community influence them to take on that role? 

• How can universities be convinced to change policies that prohibit software pub- 
lication? 

• Can funding agencies and publishers encourage documentation of programs, and 
if so, how? 

5. Discussion 

Discussion was spirited and wide-ranging, with several themes emerging from it: 

• There is no "one size fits all" solution. There are many different classes of code 
being written, from one-off tests to the codes used to produce published results. 
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• It is important to distinguish between code and algorithms; often people care 
more about the algorithms, and while code may embody an algorithm it can also 
obscure it. 

• Insisting that every last piece of code be made available sounds unrealistic, but 
code used to produce published results really matters. Some journals and fund- 
ing bodies are starting to see such code as an integral part of the work, so as 
something that needs to be available. 

• Versions of code become important for understanding its evolution and in order 
to know just which version produced a published result. 

• It is important to distinguish between accessibility and discoverability, although 
both matter. Sites such as ASCL address the discoverability problem. 

• Some people, particularly with a computer science background, are comfortable 
with putting code into GitHub from the very start which solves both the accessi- 
bility and the versioning problem. 

Releasing software increases transparency, though some are reluctant to release 
code in part because of a perceived need to be available to support the code. This could 
be mitigated with the implementation of the Community Research and Academic Pro- 
gramming License, or CRAPlfl Looking at messy codes can be instructive; software 
authors could partner with computer science students to clean code up. Science can be 
advanced by improving the skills of code authors in areas of testing (creating and pub- 
lishing test cases), clean coding, version control, and documentation. Though these did 
not come up in the BoF, suggestions for improvement can be found in Aruliah (2012). 

In the longer term, astronomy will advance faster with greater transparency of soft- 
ware and adoption of open source licenses, as others can improve and extend work that 
has already been done; methods already exist for publishing codes and managing code 
changes/versions and releases. The science can be improved by improving software 
distribution, which can be aided by the use of social coding sites. 

6. Conclusions 

Cultural change will come about fastest when agencies demand code release and as 
publications encourage or insist on it. Cost is a factor - ideally, a grant would cover the 
cost of a professional software engineer to write any necessary code, but we all know 
that isn't always possible. Therefore, science is better served by scientists releasing 
their codes and ideally learning better coding and code release practices. 
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